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1 I 

ABSTRACT 


The  purpose  of  this  paper  is  to  develop  a 
definitional  framework  for  the  constrained 
optimization  of  an  objective  function  with  stochastic 
parameters.  Included  in  this  definitional  framework 
are  the  construction  of  a deterministic  reformulation 
for  the  stochastic  problem,  guidelines  for  selecting 
an  algorithm  for  optimizing  the  deterministic 
reformulation  and  a criterion,  called  invariance, 
which  is  used  for  solution  sensitivity  analysis  in  the 
context  of  stochastic  parameter  behavior. 
Illustration  of  the  application  of  the  definitional 
framework  and  an  analysis  of  the  conditions  imposed  by 
the  invariance  criterion  is  provided  for  linear, 
piecewise  linear,  and  quadratic  functions. 
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I.  INTBODOCTION 


The  overhaul  of  a naval  vessel  is  a three  phase  event;  a 
planning  phase  of  approximately  one  year,  an  industrial  work 
phase,  and  a post-overhaul  and  inspection  phase.  The 
typical  overhaul  has  a budget  in  the  millions  of  dollars  and 
involves  several  thousand  individual  jobs  which  are  normally 
aggregated  into  a much  smaller  number  of  managerial  groups. 
In  this  paper  these  managerial  groups  will  be  referred  to  as 
stages. 

& major  event  in  the  overhaul  planning  phase  is  the  job 
screening  conference.  The  purpose  of  this  conference  is  to 
identify  the  stages  in  which  advance  planning  and 
procurement  should  commence.  This  is  accomplished  by 
individually  reviewing  the  proposed  jobs  in  each  of  the 
stages  and  selecting,  within  stage  and  overall  budget 
limits,  those  jobs  which  will  be  accomplished  during  the 
overhaul.  This  screening  process  is,  in  effect,  an  implicit 
approach  toward  an  optimal  allocation  of  the  available 
resources.  As  these  resources  are  increasingly  limited 
there  is  growing  interest  in  formalizing  the  screening 
process  into  an  explicit  optimization  which  uses  the 
standard  tools  of  mathematical  programming.  One  formidable 
obstacle  in  the  development  of  the  explicit  optimization 
model  is  the  identification  of  a measure  of  effectiveness 
which  is  applicable  to  each  of  the  stages.  Even  assuming 
the  existence  of  some  measure  there  remains  a basic  problem 
which  arises  from  the  method  of  determining  return  as  a 
function  of  resource  allocation  for  each  stage.  These  stage 
return  functions  will  rarely  be  explicitly  known  and 
therefore  must  be  estimated  from  available  data.  Regardless 
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of  the  quantity  and  quality  of  the  data  the  estimation  will 
result  in  stage  return  functions  with  parameters  subject  to 
random  error.  Thus,  in  addition  to  identification  of  a 
measure  of  effectiveness,  a prerequisite  of  explicit 
optimization  of  overhaul  planning  allocations  is  an  ability 
to  conduct  constrained  optimization  of  an  objective  function 
whose  parameters  are  subject  to  random  error. 

The  optimization  of  an  objective  function  with 
parameters  subject  to  random  error  falls  into  the  general 
realm  of  stochastic  programming.  As  noted  by  Nemhauser  [8], 
the  concept  of  optimization  in  the  presence  of  stochastic 
behavior  is  not  well  defined,  and  is  the  subject  of 
continuing  discussion.  From  this  discussion  two  definitional 
frameworks  have  arisen.  One  is  highly  theoretical  and  is 
exemplified  by  statistical  decision  and  game  theory.  The 
other  framework  is  more  computationally  oriented  and  is 
exemplified  by  the  method  which  addresses  the  creation  of  a 
deterministic  reformulation  of  the  stochastic  program  to 
which  the  optimization  can  be  applied.  There  are  several 
variants  but  the  central  idea  of  a deterministic 
reformulation  is  to  select  a particular  value  from  the  range 
of  each  of  the  stochastic  parameters,  a common  choice  is  the 
expectation,  and  to  treat  these  values  as  deterministic 
parameters  for  the  purpose  of  optimization.  The  approach  is 
open  to  considerable  criticism,  the  most  common  being  the 
failure  to  account  for  possible  effects  on  the  solution 
caused  by  differences  between  the  realizations  of  the  random 
variables  and  the  values  used  in  the  optimization. 

The  goal  of  this  research  is  to  develop,  for  an 
arbitrary  measure  of  effectiveness,  a definitional  framework 
for  the  optimization  of  the  general  class  of  stochastic 
programs  posed  by  the  overhaul  planning  problem.  The 
framework  is  to  be  computationally  oriented  and  based  on  a 
deterministic  reformulation.  The  method  defines  a concept 
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called  "invariance”  which  is  used  to  assess  the  effect  of 
stochastic  parameter  behavior  on  the  set  of  stages  in  which 
no  advance  planning  and  procurement  actions  are  indicated. 
The  criterion  is  directed  toward  this  set  rather  than  the 
set  of  stages  in  which  advance  planning  and  procurement 
should  commence  since  the  costs  associated  with  the 
erroneous  inclusion  of  a stage  in  the 
no-planning-and-procurement  set  are  much  larger  than  the 
costs  associated  with  the  erroneous  inclusion  of  a stage  in 
the  advance- planning-and-procurement  set. 

Chapter  two  will  develop  a mathematical  model  of  the 
overhaul  planning  problem,  define  the  invariance  criterion 
and  develop  the  conditions  imposed  by  this  criterion  on  the 
deterministic  reformulation  and  its  optimization.  Based  on 
these  conditions  a solution  approach  for  the  optimization  of 
the  overhaul  planning  problem  is  proposed  and  its 
application  illustrated  in  chapters  three,  four,  and  five 
for  linear,  piecewise  linear,  and  quadratic  stage  return 
functions. 
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II.  PROBLEM  FORMULATION  AND  CONCEPT  DEVELOPMENT 


A.  MATHEMATICAL  FORMULATION 


Assuming  that  there  are  n stages  to  be  considered  by  the 
screening  conference  a mathematical  formulation  of  the 
overhaul  planning  problem  is  dependent  on  the  identification 
of  a composition  operator  used  to  form  the  overall  objective 
function  from  the  individual  stage  return  functions.  As  the 
overhaul  planning  problem  is  of  an  economic  nature,  that  is: 
it  addresses  the  allocation  of  scarce  resources,  any 

arbitrary  measure  of  effectiveness  is,  in  effect,  a form  of 
utility  measure.  A reasonable  choice  for  the  composition  of 
the  stage  returns  into  an  aggregate  measure  of  the  utility 
of  the  total  overhaul  package  is  summation.  That  is,  stage 
returns  are  assumed  additive.  Based  on  these  assumptions 
one  mathematical  formulation  of  the  overhaul  planning 

problem  is: 

n 

MAX  r (d  ) 

j=1  j j 

n 

s/t  d < BD 

j=1  j 

0 < a < ub  j=T,2,...,n 

j j 

th 

is  the  j stage  stochastic  return  function. 


where 


ri  (V 
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mm 


th 

d^  is  the  j stage  decision  variable. 

BD  is  the  total  budget  constraint, 
th 

ub_^  is  the  j stage  budget  constraint. 

Based  on  the  economic  context  of  the  problem,  it  is  assumed 
that  stage  allocations  are  subject  to  diminishing  returns, 
thus  the  stage  return  functions  are  concave.  In  the  same 
context  it  is  also  reasonable  to  assert  that  the  sum  of  the 
individual  stage  budget  constraints  exceeds  the  total  budget 
constraint,  thus  at  optimality  the  total  budget  constraint 
will  be  binding. 


B.  DEFINITIONAL  FRAMEWORK 


1 . Deterministic  Stage  Returns 


As  previously  noted  the  concept  of  optimization  in 
the  presence  of  stochastic  behavior  is  not  well  defined.  The 
stochastic  optimization  problem  formulated  above  is  to  be 

defined  in  terms  of  a deterministic  reformulation,  each 

* 

r (d  ) being  converted  to  a deterministic  r (d  ) by 

j j j j 

selecting  from  the  respective  ranges  a specific  value  for 

each  of  the  stochastic  parameters.  The  optimization  of  the 
deterministic  reformulation  is  to  be  achieved  by  application 
of  one  of  the  existing  algorithms  of  mathematical 
programming.  The  specific  algorithm  will  depend  on  the  form 
of  the  stage  return  functions  used  in  the  deterministic 
reformulation. 
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Solution  Sensitjvit y Analysis 


The  effect  of  stochastic  parameter  behavior  on  the 
optimal  solution  of  the  deterministic  reformulation  can  be 
observed  from  three  viewpoints,  in  terms  of  the  values  of 
the  decision  variables  and  the  value  of  the  objective 
function,  in  terms  of  the  solution  set  or  in  terms  of  the 
complement  of  the  solution  set. 

The  solution  set  S for  an  n-variable 

m-constraint  problem  is  defined  as  the 
set  of  variables  different  from  zero. 

The  complement  of  the  solution  set, 
o 

denoted  S , is  the  set  of  variables 
which  are  zero. 


As  this  problem  is  in  a planning  context  the  solution 
set  S , which  identifies  the  stages  in  which  advance 

I 

planning  and  procurement  should  commence,  and  its  complement 
o 

S , which  identifies  the  stages  in  which  there  should  be  no 

advance  planning  and  procurement,  are  more  important  than 
the  values  of  the  decision  variables  or  the  value  of  the 
objective  function.  Since  the  costs  associated  with  a stage 

o 

being  incorrectly  included  in  S are  much  larger  than  the 
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cost  of  a stage  being  incorrectly  included  in  S , the 

sensitivity  analysis  of  the  solution  to  the  deterministic 
reformulation  should  be  directed  toward  the  complement  of 
the  solution  set.  Invariance,  defined  below,  is  the 
criteria  which  will  be  used  to  assess  the  sensitivity  of  the 
complement  of  the  solution  set  to  the  stochastic  parameter 
behavior . 

The  optimal  solution  of  the 
deterministic  reformulation  is  invariant 
with  respect  to  the  specified  ranges  of 
the  stochastic  parameters,  if  within 
those  specified  ranges  no  zero  valued 
variable  is  required  to  depart  the 
complement  of  the  solution  set,  that  is 
become  positive,  to  maintain  optimality. 

Basically  for  a solution  set  to  be  invariant  the  variables 
of  the  deterministic  reformulation  which  have  an  optimal 
value  of  zero  must  remain  at  zero  for  parametric 
perturbations  throughout  the  specified  ranges  of  the 
stochastic  parameters.  There  are  two  concepts  in  the 
definition  of  invariance  which  require  additional 
development. 

/ 

a.  Specified  Parameter  Range 

Invariance  is  defined  in  terms  of  specified 
ranges  for  each  of  the  stochastic  parameters.  Some  of  these 
parameters  may  be  the  result  of  a statistical  regression  and 
as  such  they  are  assumed  to  be  normally  distributed  random 
variables  with  a nominal  range  of  (-00,00).  Ranges  of  this 
magnitude  would  always  violate  the  invariance  criterion. 
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thus  one  requirement  for  meaningful  analysis  of  solution 
sensitivity  is  range  restriction  for  each  of  the  stochastic 
parameters.  The  restriction  must  be  accomplished  about  the 
value  of  the  parameter  used  in  the  deterministic 
ref ormulaticn  and  must  provide  a reasonable  chance  for  any 
realization  cf  the  random  variable  to  be  in  the  restricted 
range.  Additional  assumptions  for  this  paper  are  that  the 
restricted  ranges  are  symmetric  about  the  parameter  value 
used  in  the  deterministic  reformulation  and  that 

perturbations  in  any  given  restricted  range  have  no  effect 
on  perturbations  in  any  other  restricted  range. 

The  individual  restricted  ranges  may  be 
developed  with  statistical  confidence  intervals,  [4]  and 
[9],  from  previous  experience,  from  known  physical 
limitations  or  any  other  approach  which  yields  a restricted 
range  meeting  the  guidelines  established  above.  The 

specific  method  used-  to  establish  restricted  ranges  for  an 
invariance  analysis  is  not  dealt  with  in  this  paper. 

The  restricted  range  for  a stochastic  parameter 

* 

c will  be  denoted  as; 




b.  Changes  to  the  Solution  Set 

A requirement  of  the  invariance  criterion  is  an 
ability  to  identify  when  a variable  must  depart  the 
complement  of  the  solution  set  to  maintain  optimality.  For 
an  algorithm  to  be  useful  for  the  optimization  of  the 
deterministic  reformulation  in  the  context  of  the  invariance 
criterion  it  must  be  possible  to  perturb  a problem  parameter 
without  necessitating  a complete  reapplication  of  the 
algorithm. 

C.  SOLUTION  APPROACH 

For  arbitrary  return  functions  the  stochastic  program 
posed  by  the  overhaul  planning  problem  can  be  optimized 
within  the  definitional  framework  of  invariance  by: 

1.  selecting  the  parameter  values  to  be  used  in  the 
deterministic  reformulation, 

2.  restricting  the  range  of  each  stochastic  parameter 
about  the  value  selected  in  step  one, 

3.. selecting  an  appropriate  algorithm,  depending  on  the 
form  of  the  deterministic  reformulation  return 
functions,  and  optimizing  the  deterministic 
reformulation, 

4.  introducing  perturbations  within  the  established 
ranges  to  the  stochastic  parameters  and  checking  the 
invariance  condition. 
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LINEAR  STAGE  RETURN  FUNCTIONS 


The  simplest  function  in  the  general  class  of  concave 
functions  is  the  linear  function  and  while  the  assumption  of 
linear  stage  returns  may  not  be  very  realistic  in  the 
economic  context  it  does  provide  a useful  starting  point  for 
illustrating  the  application  of  the  definitional  framework 
developed  to  optimize  overhaul  planning  allocations. 


Assume  that  each  of  the  n stage  return  functions  is  a 
linear  function  of  the  form 

* * * 
r (d  ) = a ♦ c d . 

j 3 j j j 

The  initial  steps  in  the  proposed  solution  approach  are  to 

* * 

select  the  values  of  a and  c . respectively  a and  c , 

j j j j 


for  use  in  the  deterministic  reformulation  and  to  establish 


restricted  ranges  about  a and  c . Given  the  estimates  of 

j j 

a and  c with  appropriate  restricted  ranges  about  them  and 
j j 

the  general  mathematical  formulation  of  the  overhaul 
planning  problem  the  linear  deterministic  reformulation  is 
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a 


MAX  ^ (a  ♦ c d ) 

3-1  j j j 


s/t  2L-  d < BD 
3=1  j 


0 < b < ub  1=1,2,. 

j j 


As  a affects  only  the  value  of  the  objective  function  it 

j 

can  be  dropped  from  the  formulation  with  no  loss  of 
generality.  The  resultant  simplified  formulation  is 


MAX  c d 

3=1  j j 


s/t  d < 3D 

3-1  j 

0 < d < ub  j=1 , 2, 

j j 


and  the  invariance  condition  need  only  be  checked  for  the 

* 

restricted  ranges  of  c 


c = c ♦ <t> 

j j 3 

L L 

-4  < d>  < 4 . 

j j 


The  deterministic  reformulation  above  is  a linear 
program  and  the  most  common  algorithm  for  such  an 
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optimization  is  simplex.  The  simplex  algorithm  can  accept 
parameter  perturbations  via  the  parametric  sensitivity 
analysis  techniques  outlined  in  Gass  [5]  and  is  therefore 
useful  for  the  optimization  of  the  linear  deterministic 
reformulation  in  the  context  of  an  invariance  analysis. 

As  a reference  for  the  investigation  of  the  conditions 

imposed  by  the  invariance  criterion,  consider  the  following 
four  stage  (n=4)  example  problem. 

MAI  1 . 4d  + 1.6d  «■  1.3d  ♦ 1 . 7d 

12  3 4 

s/t  d ♦ d ♦ d ♦ d < 10 
12  3 4 

d <5 

1 

d <3 

2 

d <4 


d <4 
4 

d > 0 j=1,2,3,4, 


For  this  problem  the  optimal  simplex  tableau  is 


B 

c 

B 

1 

2 

3 

4 

5 

6 

7 

8 

9 

d 

1 

1.4 

1 

0 

1 

0 

1 

0 

-1 

0 

-1 

3 

6 

0 

0 

0 

-1 

0 

-1 

1 

1 

0 

1 

2 

2 

1.6 

0 

1 

0 

0 

0 

0 

1 

0 

0 

3 

8 

0 

0 

0 

1 

0 

0 

0 

0 

1 

0 

4 

4 

1.7 

0 

0 

0 

1 

0 

0 

0 

0 

1 

4 

z -c 
j j 

0 

0 

. 1 

0 

1.4 

0 

.2 

0 

.3 

where  columns  five  through  nine  are  slack  variables. 


For  notational  simplicity  and  without  loss  of 
generality  the  following  assumptions  are  made; 

1.  The  standard  simplex  tableaus  are  used  and  are 
arranged  so  that  the  first  n columns  are  the 

st 

decision  variables  (d  ) . The  n+1  column  is  the 

j 

slack  variable  for  the  total  budget  constraint, 

which  is  binding  at  optimality,  and  columns  n+2 
through  2n+1  are  the  slack  variables  for  each  of  the 
decision  variables. 

2.  At  optimality  there  is  no  degeneracy  and  no 
alternate  optimal  solution. 

Notationally  let 

B be  the  optimal  solution  set  or  basis. 

C be  the  vector  of  the  c for  1 eB. 

3 j 

th 

be  the  j column  of  the  optimal  tableau. 

I be  the  vector  of  the  4>  for  j eB. 

B j 

* 

C be  the  vector  sum  of  C and  I . 

B B B 

It  is  important  to  note  that  for  the  slack  variables  both  c 

j 

and  <b  are  zero. 

j 

Linear  optimizations  have  a property  that  for  any 
variable  to  depart  the  complement  of  the  solution  set  a 
variable  must  depart  the  solution  set.  Given  this 
one-to-one  correspondence  between  changes  in  the  solution 
set  and  its  complement  the  requirements  of  the  invariance 
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criterion  can  be  satisfied  if  within  the  specified 

restricted  ranges  for  the  stochastic  parameters  there  are  no 
changes  to  the  solution  set.  In  the  simplex  algorithm 
changes  to  the  solution  set  can  occur  only  if  the  algorithm 
optimality  criteria  are  violated.  Therefore,  the  key  to  an 
invariance  analysis  in  the  linear  case  is  the  optimality 
criterion  of  the  simplex  algorithm.  The  optimality 

criterion  of  the  simplex  algorithm  is  that 

(2  -c  ) = c P -c  > 0 Vj. 
j j B j j 

Introducing  the  perturbations  allowed  by  the  restricted 
parameter  ranges  has  the  following  effect; 

* * * 

(z  -c  ) = c P -c 
3 j B j j 

= (C  ♦ I )P.~  (c.+  *.) 

B B 3 33 

= (C  P -C  ) + (I  P -<|>  ) 

B j 3 B j j 

or 

* 

(2  -C  ) = (Z  - C ) ♦ (I  P - <fr.) 

j j 3 3 B 3 3 

and  as  the  perturbations  were  introduced  at  optimality  the 
necessary  condition  to  maintain  optimality  is  that 

- (I  P - ♦ ) < (z  - c ) Vj. 

B j j 3 j 

For  the  solution  to  be  invariant  the  optimality  maintenance 
condition  must  be  satisfied  throughout  the  restricted  ranges 
of  the  stochastic  parameters,  that  is  for 


-m  < * < * 

j 3 j 


The  presence  of  the  I term  in  the  optimality  maintenance 

B 

condition  means  that  for  any  column  j the  maintenance  of 
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optimality  is  dependent  on  perturbations  to  parameter  and 

on  perturbations  to  the  parameters  of  the  variables  in  the 
optimal  basis.  Thus  in  the  optimality  maintenance  condition 
for  any  column  j there  are  mutual  dependence  effects  from 
the  stochastic  parameter  perturbations. 

The  constraint  matrix  of  the  problem  has  a structure 
which  produces  an  optimal  tableau  whose  elements  are  either 
minus  one,  plus  one,  or  zero.  Further  the  assumption  that 
the  total  budget  constraint  is  binding  at  optimality 
produces  an  optimal  tableau  with  only  four  types  of  columns. 
These  column  types  are  identified  as  follows; 

Type  0 = columns  of  basic  variables. 

Type  A = columns  of  non-basic  decision  variables. 

Type  E = columns  of  non-basic  slack  variable. 

Type  C = the  column  of  the  non-basic  slack  variable  of 
the  total  budget  constraint. 

These  special  features  reduce  the  mutual  dependence  effects 
of  parameter  perturbations  in  the  optimality  maintenance 
condition  and  allow  the  development  of  tests  of  invariance 
for  each  of  the  column  types  identified. 


A.  TESTS  OF  JNVAHIANCE 


Due  to  the  special  structure  of  the  problem  the  simplex 
algorithm  will  bring  the  decision  variables  into  the  basis 
at  their  upper  bounds  ub  sequentially  in  decreasing  order 

of  the  rates  of  return.  Under  these  circumstances 

optimality  will  occur  when  the  entering  decision  variable 
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causes  the  total  budget  constraint  to  become  binding.  The 

decision  variable  which  causes  the  total  budget  constraint 

to  become  binding  will  be  the  final  variable  to  enter  the 

basis  and  will  be  denoted  d . For  the  example  problem  d is 

f f 


d . 
1 


1 . Column  Type  _C 

As  shown  in  Gass  [5]  parametric  perturbations 
produce  no  change  in  the  optimality  conditions  for  type  0 
columns,  that  is 


* 

(z  -c  ) = (z  -c  ) = 0. 

j j j i 

Thus  there  is  no  requirement  to  examine  the  columns  of  the 
optimal  basis  under  the  invariance  criterion.  In  the 
example  problem  columns  one,  two,  four,  six,  and  eight  are 
type  0 columns. 


2.  Column  Type  A 


Column  three  of  the  example  problem  is  a type  A 
column.  In  general  any  column  j of  type  A has  three 
non-zero  elements.  These  elements  are  located  as  follows: 

A plus  one  in  the  row  of  d . In  the  example  problem 
this  is  row  one. 

A plus  one  in  the  row  of  the  slack  variable 

th 

associated  with  this,  the  j , variable. 
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r 


A minus  one  in  the  row  of  the  slack  variable 

associated  with  d . Prom  the  tableau  assumptions 

f 

the  slack  variable  associated  with  d is  variable 

f 

n+f+1.  In  the  example  problem  this  is  variable  six 
which  is  associated  with  tableau  row  two. 


As  the  $ of  the  slack  variables  are  zero  the  scalar  product 
I P for  a type  A column  must  always  be 

B j 

I P = <t> 

B j f 

and  the  optimality  condition  is 


-<♦-*.)  < (z  -c  ) • 
f j D j 


As  (z  -c  ) is  a positive  quantity  the  worst  condition  for 

j j 

invariance  is  at 


and  the  test  for  invariance  in  a type  A column  is 


L L 

<b  ♦ <fc  < 

f j 


(YV 


3 • Column  Type  B 


Examples  of  type  B columns  can  be  found  in  columns 
seven  and  nine  of  the  example  problem.  In  general  any 
column  j of  type  B has  three  non-zero  elements.  These 
elements  are  located  as  follows: 
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In  the  example 


A minus  one  in  the  row  of  the 
problem  this  is  row  one. 


d . 
f 


A one  in  the  row  of  the  slacic  variable  of  d . From 

f 

the  tableau  assumptions  the  slacic  variable 

associated  with  d is  variable  n+f+1.  In  the 

f 

example  problem  this  is  variable  six  which  is 
associated  with  tableau  row  two. 


A one  in  the  row  of  the  decision  variable  associated 
with  this  slack  variable,  by  the  tableau  assumptions 
this  is  variable  j-(n+1). 


For  this  type  of  column  the  scalar  product  IP  is 

B j 


IP  = -h  ♦ 4> 

B j f j-(n+1) 

and  the  optimality  condition  is 

- (-♦  ♦ <J> . ) < (z  -c  ) . 

f D-(n  + 1)  3 3 

The  worst  condition  for  invariance  occurs  when 


♦ = <t> 

f f 


<t>  = -*4> 

j-(n+1)  j-(n+1) 


and  the  test  of  invariance  for  a type  B column  is 


L 

<}> 

j~  (n+ 1 ) 


< (z  -c  ) . 
j j 
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Column  Type  C 


i 


An  example  of  a type  C column  is  column  five  of  the 
example  problem.  In  general  for  column  (n  + 1) , which  is  the 
only  type  C column,  there  are  two  non-zero  elements.  These 
non-zero  elements  are  located  as  follows: 

A one  in  the  row  of  d^.  in  the  example  problem  this 

is  row  one. 

A minus  one  in  the  row  of  the  slack  variable 

associated  with  d . From  the  tableau  assumptions 

f 

the  slack  variable  associated  with  d is  variable 

f 

n+f+1.  In  the  example  problem  this  is  variable  six 

which  is  associated  with  tableau  row  two. 


The  scalar  product  I P for  the  type  C column  is 

B n»  1 


IP  = t 
B n+1  f 


and  the  optimality  condition  is 

- < (z  -c  ) . 

f j j 

The  worst  condition  for  invariance  occurs  when 


<£  = - <J> 

1 f 

and  the  test  for  invariance  in  the  type  C column  is 


4>  < (z  -c  ) 

f j j 
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The  solution  set  is  said  to  be  invariant  with  respect 
to  the  specified  parameter  ranges  if  the  tests  of  invariance 
are  not  violated  for  any  of  the  columns  of  the  optimal 
tableau. 

The  tests  developed  above  are  sufficient  but  not 
necessary  conditions  for  invariance.  Under  certain 
conditions  violation  of  the  sufficiency  test  for  a type  B 
column  may  not  result  in  a violation  of  invariance.  This 

+ 

will  occur  when  a variable  in  S can  become  zero  without 

o 

requiring  a variable  in  S to  become  positive.  The  condition 
for  this  occurence  is  that  it  must  be  possible  to  allocate 
all  of  the  units  of  resource  from  the  variable  which  is 
dropping  to  zero  to  the  variable  whicn  is  in  the  solution 
set  but  not  at  its  upper  bound  (d^) . If  the  violation  of  the 

sufficiency  test  for  a type  B column  occurs  in  column  i a 
new  condition  for  invariance  should  be  checked.  This 
condition  is 


ub  > ub  - d . 

i~ (n+ 1 ) f f 

The  solution  will  not  be  invariant  if  this  condition  is 

satisfied  since  the  resource  not  allocated  to  d must  be 

f 

o 

allocated  to  some  variable  in  S to  maintain  optimality.  If 

the  condition  is  not  satisfied  the  solution  may  be  invariant 
but  to  determine  whether  or  not  the  solution  is  invariant 
requires  additional  tableau  pivots. 

Recognizing  that  the  simplex  algorithm  brings  the 
decision  variables  into  the  solution  set  at  their  upper 
bounds  sequentially  in  decreasing  order  of  their  rates  of 
return  and  that  optimality  occurs  when  a decision  variable 
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can  enter  only  at  some  value  less  than  its  upper  bound  a 
logical  statement  of  a test  of  invariance  is 

* * 

max  c < min  c 

je  S°  3 j£S*  3 

This  condition  is  equivalent  to  the  tests  of  invariance 
developed  above. 


r 
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IV. 


PIECEWISE  LINEAR  RETORN  FUNCTIONS 


Since  piecewise  linear  functions  can  exhibit  diminishing 
marginal  returns  they  are  economically  more  realistic  than 
the  simple  linear  function.  This  increase  in  economic 
realism  is  gained  at  the  loss  of  some  of  the  mathematical 
simplicity  of  the  simple  linear  return  model.  However,  the 
highly  desirable  property  of  linearity  is  retained. 
Piecewise  linear  functions  generally  arise  from  two  sources, 
one  is  segmented  linear  regression.  The  second  and  more 
common  source  is  the  approximation  of  non-linear  functions. 

Assume  that  the  individual  stage  return  functions  are 
piecewise  linear  functions  of  the  form 


* 1#  l 2*  2 * 

r(d)=a  + c d ♦ c d +...+C  d 

j j j j j j j j j 


where 


i 2 k 

d=d  +d  +...+d 

j j j j 

m m 

0 < d <ub  m=1 , 2 , . . . , k 

j j 


and  to  ensure  the  desired  concavity 

m m+1 

b ^ b m-1 , 2,  . . . ,k- 1 . 

Given  the  economic  context  of  the  problem  it  is  reasonable 
to  assert  that  marginal  returns  are  strictly  positive.  This 
reguires  the  piecewise  linear  function  to  be  monotone  and  is 
ensured  if 


b >0. 

j 
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Graphically  a typical  three  segment  piecewise  linear  stage 
return  function  will  have  the  form 


<£  H 


A further  requirement  which  ensures  that  the  algorithm  used 
for  the  optimization  of  the  deterministic  reformulation 

m + 1 

correctly  models  the  piecewise  linear  function  is  that  d 

m m 

remain  at  zero  until  d is  at  ub  . It  should  also  be 

j j 


noted  that 


thus  the  original  stage  constraints  remain  in  force.  The 
assumption  of  k segments  for  each  of  the  piecewise  linear 
functions  is  for  notational  simplicity  and  is  made  without 
loss  of  generality. 


The  parameters  c can  be  regarded  as  approximations 

j 

th 

to  the  slope  of  the  j-  stage  return  function  over  the 
m-1  m 

interval  [ ub  , ub  ] and  as  such  they  are  subject  to 

j j 

random  error.  It  must  be  noted  that  in  addition  to  the 

guidelines  for  restricted  ranges  established  in  chapter  two 
the  restricted  ranges  in  the  piecewise  linear  case  must 
ensure  that  the  function  remains  concave  and  monotone 

mL 

increasing.  If  the  limits  for  a restricted  range  are  -<fr 

j 

mL 

and  <p  ^ the  maintenance  of  concavity  requires  that 


m mL  rn+1 

c.  - * > c ♦ <t> . 

J j j j 


(m  + 1 ) L 


m=  1 ,2 , . . . ,k-1 


and  to  maintain  the  monotonic  behavior  requires  that 


k kL 

c - 4 > 0 . 

j j 


Given  the  estimates  of  the  c 's  with  appropriate 
restricted  ranges  about  them  and  the  general  mathematical 


formulation  cf  the  overhaul  planning  problem  the  piecewise 
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linear  deterministic  reformulation  is 


MAX  Z_(a  ♦ 2_  c d ) 
j=1  j m=1  j j 


n k 

s/t  d m < BD 

j=1  m= 1 j 

m m 

0 < d < ub  j=1,2, . . .,n 

j j 


As  a affects  only  the  value  of  the  objective  function  it 

j 

can  be  dropped  from  the  formulation  with  no  loss  of 
generality.  The  simplified  formulation  which  results  is 


□ k 

~ m m 
c d 

j-1  a=1  j j 

n k 

s/tZ  Z d m < BD 
j=1  m=1  j 


0 < d < ub  j=1 ,2, , . . ,n 
. j 

m — 1,2,. . . , k 


and  the  invariance  criterion  need  only  be  checked  for  the 

m* 

restricted  ranges  of  c 


m*  m m 

c = c +4 

j j Tj 
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oL 


■L 


j 


a 


The  deterministic  reformulation  above  is  a linear 

■ ♦ 1 

program  except  for  the  requirement  that  d remain  at  zero 

m m 

until  d is  at  ub  . Fortunately  this  requirement  does  not 

j j 

prevent  the  use  of  the  simplex  algorithm  since,  as  shown  by 

Dantzig  [1]  and  [2],  the  concavity  of  the  objective  function 
ensures  that  the  requirement  will  De  satisfied  at 
optimality.  Thus  the  simplex  algorithm  is  applicable  for 
the  optimization  of  the  piecewise  linear  deterministic 
reformulation. 


For  notational  simplicity  and  without  loss  of 
generality  the  following  assumptions  are  made; 

1.  The  standard  simplex  tableaus  are  used  and  are 
arranged  so  that  the  first  nk  columns  are  the 

m st 

decision  variables  (d  ).  The  nk+1  column  is  the 

j 

slack  variable  for  the  total  budget  constraint, 

which  is  binding  at  optimality,  and  columns  nk+2 
through  2nk+1  are  the  slack  variables  for  each  cf 
the  decision  variables. 

2.  The  column  arrangement  is  by  block  according  to  the 
variable  index  j and  within  each  block  the  k 
segments  are  in  order  from  one  to  k.  Thus  the  column 
arrangement  is  of  the  form 

12  k 1 k 1 k 

d d ...d  d ...d  d d ...d  . 

11  12  n n+1  n+2  2n+1 
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3.  There  is  a tableau  row  for  each  variable  to  enforce 
its  respective  bound.  Thus  the  tableau  will  have 
nk*1  rows  and  2nk+1  columns. 

4.  At  optimality  there  is  no  degeneracy  and  no 
alternate  optimal  solution. 

Notationally  let 

B be  the  optimal  solution  set  or  basis. 

m m 

C be  the  vector  of  the  b for  d cB. 

B j j 


P be  a column  of  the  optimal  tableau. 

j 


m m 

I be  the  vector  of  * for  d e B. 
B j j 


C be  the  vector  sum  of  C and  I . 
B B B 


The  optimization  of  piecewise  linear  functions  is  a 
linear  optimization  and  as  such  there  is  a one-to-one 
correspondence  between  changes  to  the  basic  and  non-tasic 
variables.  However  in  the  piecewise  linear  case  this  is  not 
equivalent  to  a one-to-one  correspondence  between  changes  to 
the  solution  set  and  its  complement.  This  is  due  to  the  fact 
that  in  the  piecewise  linear  case  invariance  is  directed  at 
the  original  variables  d not  at  the  piecewise  segment 

m 

variables  d . The  invariance  condition  can  be  stated  as; 

j 

if  within  the  specified  restricted  ranges  for  the  stochastic 


1 o 

parameters  the  d which  are  in  S remain  at  zero  the 

j 
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solution  is  invariant.  This  condition  can  be  checked  through 


the  simplex  algorithm  optimality  criteria.  In  the  notation 
of  the  piecewise  linear  case  the  optimality  criterion  of  the 
simplex  algorithm  is 


mm  m m u 

(z  -c  ) = C P -c  >0  yj#  m=1,2,...,k. 

j j 3 j j 


Introducing  the  perturbations  allowed  by  the  restricted 
parameter  ranges  has  the  following  effect; 


m m * 
(z  . -c  . ) 

1 D 


or 

m m * 

(z  . - c ) 

1 3 

and  to  maintain  optimality 

- (IP  . 10  - * ) < (z  . - c ). 

B 3 j 3 j 


The  invariance  criterion  requires  that  the  optimality 
maintenance  condition  be  satisfied  throughout  the  specified 
restricted  ranges  of  the  parameters,  that  is  for 


mL  m mL 

-<j>  < <t>  < $ 

j j 3 


* m 

m* 

= C P 

- c 

3 j 

j 

m 

m 

m 

= (C  + I 

) P . 

- (C  + 

4>.  ) 

3 

3 3 

3 

3 

m 

m 

m 

m 

= (C  P 

-c  . ) 

* t1* 

- <>  . ) 

3 j 

3 

3 3 

3 

m 

m 

m 

m 

= (z  - 

c . ) 

+ (I  P 

- ) 

j 

j 

3 j 

j 

m 

m 

m 

The  piecewise  linear  optimality  maintenance  condition 
is,  with  notational  differences,  the  same  as  the  simple 
linear  case.  The  only  real  differences  are  that  there  are 
now  nk  total  decision  variables  instead  of  the  n for  the 
simple  linear  case  and  that  the  optimality  maintenance 
condition  need  not  be  checked  for  all  of  the  columns  cf  the 
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optimal  tableau  for  the  so3.ution  to  be  invariant.  The 
columns  for  which  the  optimality  maintenance  condition  need 
not  be  checked  are  those  of  the  non-basic  structural 
variables  which  do  not  affect  invariance,  that  is  the 

m 

columns  of  d where  m>1.  These  variables  do  not  affect 

j 

invariance  since  the  invariance  condition  for  the  piecewise 

1 

linear  problem  is  stated  in  terms  of  the  d which  are  in 

j 

o 

S . The  special  features  of  the  problem,  namely  the 

constraint  matrix  structure  and  the  assumption  of  a binding 
total  budget  constraint,  are  intact  and  the  optimal  tanleau 
has  the  same  four  column  types  and  element  arrangements  as 
the  simple  linear  tableau.  Thus  the  invariance  analysis  for 
piecewise  linear  functions  is  virturally  identical  to  that 
of  the  simple  linear  case.  The  difference  is  that  the  only 
type  A columns  which  must  be  checked  for  invariance  in  the 

1 

piecewise  linear  case  are  those  associated  with  d ' s which 
o 

are  in  S . Since  the  analysis  for  the  columns  which  must  be 

checked  is  the  same  in  the  piecewise  linear  problem  as  in 
the  simple  linear  problem  the  tests  of  the  simple  linear 
case  will  simply  be  restated  in  the  current  notation  for 
those  columns  of  the  piecewise  linear  case  which  are 
relevant  under  the  invariance  criterion. 

A.  TESTS  OF  INVAHIAMCE 

As  in  the  simple  linear  case  the  subscript  f denotes  the 
decision  variable  which  upon  entry  into  the  basis  causes  the 
total  budget  constraint  to  become  binding. 
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1 • Column  Tv pe  j.  (basic  variables} 


No  examination  of  the  columns  of  the  optimal  basis 
is  required  under  the  invariance  criterion. 


2 . Column  Type  A (non-basic  structural  variables) 


As  pointed  out  above  the  only  columns  of  type  A 
which  are  relevant  under  the  invariance  criterion  are  those 

1 

associated  with  d 's.  The  test  of  invariance  for  a relevant 

j 

type  A column  is 


L 1 L 1 

+ $ < (z  - c ) 

f j j j 


3 . Column  Type  3 (non-basic  slack  variables) 


The  test  for  invariance  for  any  column  of  type  B is 


L mL  mm 

4 + 4»  < (z  - c ) . 

f j" (n+1)  j j 


4 • Column  Type  C (budget  constraint  slack  variabl e) 


The  test  for  invariance  for  the  type  C column  is 


(z 


nk-M 


c 

nk  + 1 


) • 
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The  solution  set  is  said  to  be  invariant  with 
respect  to  the  specified  parameter  ranges  if  the  tests  of 
invariance  are  satisfied  for  all  relevant  columns  of  the 
optimal  tableau. 

As  in  the  simple  linear  case  the  tests  above  are 
sufficient  but  not  necessary  conditions  for  invariance. 
Under  certain  conditions  a violation  of  the  type  B column 
sufficiency  test  may  not  be  a violation  of  invariance.  This 

4* 

occurs  when  a variable  in  S can  become  zero  without 

o 

requiring  a variable  in  s to  become  positive.  The  condition 
for  this  occurence  is  that  it  must  be  possible  to  allocate 
all  of  the  units  of  resource  from  the  variable  which  is 
dropping  to  zero  to  the  variable  which  is  in  the  solution 
set  but  net  at  its  upper  bound  (d^) . However  in  the 

piecewise  linear  case  it  is  not  possible  to  state  a 

condition  which  checks  for  this  behavior.  This  is  due  to  the 
fact  that  violation  of  the  allocation  condition  stated  above 
may  not  result  in  a violation  of  invariance  since  the  units 
of  resource  not  allocated  to  d may  be  allocated  either  to  a 

m 

d where  m>  1 , which  would  not  violate  invariance,  or  to  a 
1 

d which  would  violate  invariance. 

j 

As  in  the  simple  linear  case  the  simplex  algorithm 
will  bring  the  decision  variables  of  the  piecewise  linear 
case  into  the  solution  set  at  their  upper  bounds 
sequentially  in  decreasing  order  of  their  rates  of  return. 
Optimality  will  still  be  achieved  when  an  entering  decision 
variable  encounters  the  total  budget  constraint  and  the 
logical  statement  of  the  tests  of  invariance  remains 
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1* 


m* 


max  c < min  c 

jfiS"  j j*s*  j 


m=1,2. 


k . 


The  solution  is  said  to  be  invariant  if  this  condition  is 
satisfied  throughout  the  specified  restricted  ranges. 


A 
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V.  QUADRATIC  STAGE  RETURN  FUNCTIONS 


Quadratic  functions  are  another  move  toward  economic 
realism  for  the  overhaul  planning  problem  stage  return 
functions.  The  advantage  of  a quadratic  function  is  that 
marginal  returns  can  be  made  to  be  continuously  decreasing 
whereas  the  piecewise  linear  function  could  only 
incrementally  decrease  marginal  return.  The  gain  in  realism 
with  the  quadratic  function  has  a large  price,  the  loss  of 
linearity.  However  this  loss  is  partially  offset  since  rue 
quadratic  function  is  one  of  the  simplest  of  the  non-linear 
functions  and  there  is  some  advantage  over  piecewise  linear 
functions  because  of  the  reduced  number  of  parameters  and 
variables. 

Assume  that  each  of  the  n stage  return  functions  is  a 
quadratic  function  of  the  form 


* * 1*2 

r (d  ) = a d — b d 

j j j j 2 j j 


The  conditions  for  the  desired  properties  of  decreasing  but 
always  positive  marginial  returns,  or  monotonic  concavity, 
are  that  the  first  derivative  be  non-negative  and  the  second 
derivative  be  strictly  negative.  This  means  that 


a > b ub 

j j j 

b > 0. 

j 

It  should  be  noted  that  the  restricted  ranges  in  the 
quadratic  case  must,  in  addition  to  satisfying  the 
guidelines  of  chapter  two,  maintain  the  monotonic  concavity 
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of  the  individual  stage  return  functions.  If  the  limits  of 

* * L 

the  restricted  ranges  of  a and  b are  respectively  ±<fc 

j j 1 

L ... 

and  ±0  the  maintenance  of  monotonic  concavity  requires 

1 


that 


L 

b - 9 >0 

j j 

and 

L L 

a - d>  > (b  + 9 ) ub  . 

j j j j j 


Given  the  estimates  of  a and  b with  aopropriate 

j j 

restricted  ranges  about  them  and  the  general  mathematical 


formulation  cf  the  overhaul  planning  problem  the  quadratic 
deterministic  reformulation  is 


n 

MAX  a d - — b d 

j = 1 j j 2 j j 


n 

s/t  IE.  d < BD 

:=■>  j 


0 < d < ub  j=  1 , 2 , . . . n. 

j j 


The  invariance  condition  must  be  checked  for  the  restricted 

* 

ranges  of  b 

j 


* 

b = b ♦ 9 
3 3 j 
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L L 

-e  < 0 < 0 

j j j 


and  for  the  restricted  ranges  of  a 

j 


a = a + 0 

j j j 

L L 

-6  < d>  < d>  . 

j j j 

It  will  be  notationally  convenient  to  shift  to  matrix 
notation  where 


D 

is 

an 

(nxl) 

vector  of  decision  variables 

E 

is 

an 

(nxl) 

vector  of  parameters  b . 

j 

A 

is 

an 

(nxn) 

positive  definite  diagonal 

parameters 

a . 
j 

I 

is 

an 

(nxn) 

identity  matrix. 

* 

1 

is 

an 

(nxl) 

vector  of  1 ' s. 

UB 

is 

an 

(nxl) 

vector  of  the  stage  constrai 

The  deterministic  reformulation  can  be  written  in  matrix 
notation  as 

t i t 

MAX  R (D)  = A D B DB 

2 

t * 

s/t  D 1 < BD 

0 < ID  < OB. 


This  is  a convex  non-linear  program  and  the  Kuhn-Tucker 
conditions  are  necessary  and  sufficient  for  optimality. 
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The  initial  attempt  to  optimize  the  deterministic 
reformulation  and  apply  the  invariance  criterion  involved 
the  use  of  quadratic  programming,  specifically  the  algorithm 
of  Dantzig  as  described  by  Boot  [3],  While  this  algorithm  is 
simplex  based  and  tecnnically  satisfies  the  requirements  for 
the  application  of  the  invariance  criterion  it  involves  a 
reformulation  via  the  Kuhn-Tucker  conditions  and  the 

resultant  problem  proved  to  be  conceptually  and 

computationally  difficult.  The  specific  difficulties  were; 

1.  The  reformulated  problem  is  conceptually  an 
existence  problem  rather  than  an  optimization 
problem.  Thus  there  is  no  objective  function  in  the 
usual  sense  and  this  prevents  the  determination  cf 
optimality  maintenance  conditions. 

2.  The  parameters  to  which  perturbations  are  applied 
are  in  the  constraint  matrix  and  on  the  right  hand 
side  rt  the  reformulated  problem.  This  situation  is 
almost  impossible  to  handle  when  perturbations  are 
applied  to  more  than  one  parameter. 

The  second  algorithm  selected  for  the  optimization  was 
the  reduced  gradient  algorithm,  [6],  [7],  and  [10].  This 
algorithm  is  very  similiar  to  the  simplex  procedure, 
identifing  variables  as  either  basic  or  non-basic.  One  of 
the  important  differences  between  this  algorithm  and  simplex 
is  that  here  the  basic  variables  must  be  positive  and  the 
non-basic  variables  may  be  different  from  zero'.  The  reduced 
gradient  algorithm  can  also  handle  parameter  perturbations 
without  having  to  reapply  the  entire  algorithm,  thus  the 
algorithm  is  applicable  under  the  requirements  of  the 
invariance  criterion.  To  put  the  deterministic  equivalent 
into  the  standard  format  of  the  reduced  gradient  algorithm 
add  slack  variables  to  the  constraint  matrix  and  denote  the 
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L 


W 


result  as 


a 


t * 

d 1 


1 

1 ' O' 

3D 

1 

< 



* 1 

0 I1 

U 3 

where 

0*  is  an  (Ixn)  vector  of  zeros. 

* 

0 is  an  (nxl)  vector  of  zeros. 


addit ionally 


at  optimality  let 


Z be  the  set  of  the  n+1  basic  variables. 

N be  the  set  of  n non-basic  variables. 

P be  the  matrix  of  the  columns  of  W associated  with 
the  basic  variables. 

C be  the  matrix  of  the  columns  of  Sf  associated  with 
the  non-basic  variables. 


th 

q be  the  1 

k,l 


th 

element  in  the  k row  of  Q 


It  should  be  noted  that 


-1 

P C. 


1.  The  solution  set  S has  elements  from  both  Z and  N. 

o 

2.  The  complement  of  the  solution  set  s has  elements 
only  frcm  N. 

3.  The  column  arrangement  of  W is  the  same  as  the 
column  arrangement  of  the  constraint  matrix  in  the 
linear  case. 

4.  For  the  slack  variables  $ , 9 , and  d are  all  zero. 

j j j 
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In  the  quadratic  case  there  is  no  one-to-one 
correspondence  between  changes  in  the  solution  set  and  its 
complement.  Thus  the  use  of  the  invariance  criterion  in  the 
quadratic  case  requires  a direct  application  of  the 
definition  cf  invariance,  that  is  the  invariance  analysis 

o 

must  be  focused  on  the  complement  of  the  solution  set,  S . 

The  maintenance  of  optimality  in  the  quadratic  case  is  not 
necessary  for  invariance,  in  fact  optimality  will  probably 
never  be  maintained.  However,  the  optimality  condition  of 
the  reduced  gradient  algorithm  does  provide  a method  for 
checking  the  invariance  criterion.  The  optimality  condition 

of  the  reduced  gradient  algorithm  is  that  all  elements  u of 

j 

the  movement  vector  U,  defined  below,  be  equal  to  zero.  The 
elements  of  the  movement  vector  are  defined  as 


th 

where  HG  is  the  j component  of  the  reduced  gradient  HG 

3 

and 


- 1 

P C + 7 R (D) 
N 


or 


RG  = - (a  - b d ) q +(a  - bd). 

j zeZ  z z z z,j  j j j 
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The  key  for  the  invariance  criterion  is  that  the 

o 

variables  in  the  complement  of  the  solution  set  (S  ) are 

specifically  required  to  have  a reduced  gradient  component 

o 

which  is  non- positive.  Departures  from  S can  only  occur  if 

the  perturbations  within  the  specified  restricted  ranges 
cause  the  reduced  gradient  component  of  one  of  the  variables 
o 

in  S to  become  positive,  thus  invariance  is  dependent  on 

the  changes  to  the  reduced  gradient  components  of  the 
o 

variables  in  S produced  by  the  parametric  perturbations. 

Introducing  the  parameter  perturbations  allowed  by  the 
restriced  ranges  has  the  following  effect  on  the  reduced 
gradient . 


* * * * * 

RG  = - 2i-  (a  -bd)q  ♦ a - b d 
j zeZ  z zzz,j  j jj 


3 - 21  (a  ♦ \ ~(b  + 0)d)q 

zeZ  z z z z z z,j 

♦ (a  ♦ <fc  ) - (b  ♦ 0 ) d 
j j j J j 


bd)q  ♦a  - bd 
z z z,  j j j j 


21  (* 

zeZ  z 


6 d )g  ♦ i> 
z z z,j  j 


0 d 

j j 


= HG  -T  (4  - e d ) q ♦ 4 

j z eZ  z z z z , j j 


9 d . 

j j 


* o 

For  invariance  the  RG  of  the  variables  in  S must  remain 

j 

o 

non-positive.  Noting  that  d for  all  variables  in  S must  be 
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zero  the  changes  in  the  reduced  gradient  components  of  the 
o 

variables  in  S simplifies  to 

* 

RG  = RG 

j j 

Since  RG  is  a non-positive  quantity  the  condition  for  the 

* 

maintenance  cf  non-positive  RG  can  be  expressed  as 


zeZ 


(♦  ~ 
z 


0 d ) q 
z z z 


V 


TT — 0 

RG  > - (<J>  - 9d)q  ♦<)>  V jeS 

j zeZ  z z z z,j  j 


and  for  invariance  this  condition  must  be  maintained  fcr  all 
o 

variables  in  S and  throughout  the  specified  restricted 


ranges,  that  is  for 


1 

-e- 

i_i. 

i 

-e- 

VI 

L 

-0 

j 

■n 

® 

VI 

< 0 

L 

L 


The  condition  for  the  maintenance  of  non-positive  RG 


o 

for  the  variables  in  S can  be  simplified  by  examining  the 


structure  of  the  constraint  matrix  W,  which  has  exactly  the 


same  structure  as  the  constraint  matrix  of  the  linear  case. 
Although  in  the  quadratic  case  there  can  be  more  than  one 
variable  in  the  solution  that  is  not  at  its  upper  bound  the 
structure  of  H allows  for  the  occurence  of  only  one  of  them 
in  the  basis  set  Z.  This  arises  as  follows; 


The  occurence  of  a variable  which  is  not  at  its  upper 
bound. in  the  basis  set  Z requires  that  both  the  variable 
and  its  slack  be  in  Z.  This  requires  that  the 
(n+1)x(n+1)  matrix  P,  which  must  be  non-singular. 
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1 


contain  both  the  column  of  the  structural  variable  and 
the  column  of  the  slack.  Each  variable/slack  pair  after 
the  first  fills  two  column  dimensions  but  only  one  row 
dimension  in  P.  If  an  attempt  is  made  to  identify  i>1 
variables  as  not  being  at  their  upper  bounds  there  will 
be  (n-  i+1)  filled  column  dimensions  but  only  (n-i) 
filled  row  dimensions  in  P.  Of  the  remaining  In  - i «• 
1)  variables  in  the  basis,  each  is  identified  as  being 
at  its  upper  bound  and  fills  only  one  row  and  only  one 
column  dimension  in  P.  Thus  the  net  result  of  trying  to 
identify  mere  than  one  variable  as  not  being  at  its 
upper  bound  is  an  unfilled  row  dimension  in  p and  this 
row  of  zeros  makes  P singular,  which  is  in  violation  of 
the  requirement  for  P. 


Since  only  one  variable  can  be  identified  as  being  in  the 
solution  but  not  at  its  upper  bound  the  basis  in  the 
quadratic  case  is  exactly  the  same  as  in  the  linear  case  and 
the  representation  of  the  non-basic  columns  of  W,  that  is  Q, 
at  optimality  is  exactly  the  same  as  in  the  linear  case. 
This  means  that  the  columns  of  Q associated  with  the 
o 

variables  in  S have  the  same  structure  as  the  columns  of 


the  linear  case  which  are  associated  with  non-basic,  and 


therefore  zero  valued,  variables.  The  columns  of  Q 

o 

associated  with  variables  in  S are  either  type  A,  B,  or  C 


columns  where 


type  A = columns  associated  with  structural  variables. 


type  B = columns  associated  with  slack  variables. 


type  C = the  column  associated  with  the  slack  of  the 
total  budget  constraint. 


A. 


TESTS  OF  INVARIANCE 


Denote  the  set  of  variables  which  are  in  the  solution 

but  not  at  their  upper  bounds  as  the  set  F.  The  variable  of 

F which  is  identified  as  being  in  the  basis  but  not  at  its 

upper  bound  will  be  denoted  as  d . With  this  notation  the 

f 

arrangement  of  the  elements  in  the  quadratic  type  A,  B,  and 

C columns  is  identical  to  the  arrangement  of  the  elements  in 
the  linear  type  A,  B,  and  C columns.  For  details  of  these 
arrangements  see  pages  22,  23,  and  25  respectively. 


1 • Column  Type  A (structur al  variables) 


o 

For  d e S that  are  structural  variables  the 

j 

columns  of  Q will  have  the  structure  of  the  type  A column. 


* 

see  page  22.  Under  this  condition  the  summation  in  the  RG 

j 

maintenance  condition  becomes 


- Vf’ 


and  the  condition  for  the  maintenance  of  non-positive  RG 


is 


Irg  | > - ( 4 - 0 d ) ♦ 6 . 

I jl  f f f j 
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T 


To  obtain  a test  of  invariance  the  variable  identifed  as 
being  in  the  solution  but  not  at  its  upper  bound  must  be  the 
variable  in  F which  has  the  largest  deviation  from  its 
optimal  value  marginal  return,  that  is  select  d^  to 

L L 

max  ( <k  ♦9  d ) . 

UF  f f f 


The  test  of  invariance  for  a type  A column  is 


L L L 

RG  > max  ( | ♦ 9 d ) ♦ <J> 

j f f f j 


2 • Column  Type  B (slack  variables) 


For  d e_ S that  are  slack  variables  the  columns  of 

j 

Q will  have  the  structure  of  the  type  B column,  see  page  23. 

* 

Under  this  condition  the  summation  term  in  the  RG 

j 

maintenance  condition  becomes 


-(  $ - 9 d ) - ( $ -9  d ) 

f f f j-(n+1)  j-(n  + 1)  j-  (n+ 1) 

The  test  of  invariance  for  type  B columns  is 


(RG  I > max  ( <»  L * 0 Ld  ) 
1 j1  f«F  f f f 


f f 

L L L 

♦■  ( 4*  -9  d ) ♦ <b  . 

j-(n+1)  j-(n+1)  j-(n+1)  j 
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3 . Column  Type  C (budget  constraint  slack  variable) 


The  slack  variable  associated  with  the  total  budget 

constraint  is  variable  n+1.  The  column  of  Q associated  with 

d is  a type  C column,  see  page  25.  Under  this  condition 
n+1 


* 

the  summation  term  in  the  RG 

j 


maintenance 

-0  d ) 
f f 


condition  becomes 


and  the  test  of  invariance  is 


, L L 

RG  > max  ( <$  + 0 d ) 

7 feF  f f f 


The  solution  is  said  to  be  invariant  with  respect  to  the 
specified  parameter  ranges  if  the  tests  of  invariance  hold 


for  all  d e S . 

j 


The  tests  developed  above  are  sufficient  but  not 
necessary  conditions  for  invariance.  Under  certain 
conditions  violation  of  the  sufficiency  test  for  a type  B 
column  may  not  result  in  a violation  of  invariance.  This 

♦ 

will  occur  when  a variable  in  S can  become  zero  without 

o 

requiring  a variable  in  S to  become  positive.  The  condition 
for  this  occurence  is  that  it  must  be  possible  to  allocate 
all  of  the  units  of  resource  from  the  variable  dropping  to 
zero  to  the  variables  in  the  solution  set  that  are  not  at 
their  upper  bounds.  If  the  sufficiency  test  for  a type  B 
column  is  violated  for  slack  variable  i a new  condition  for 
invariance  should  be  checked.  This  condition  is 
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d > ^L.  (ub  - d ) . 

i-  (n+1)  feF  f f 

If  this  condition  is  satisfied  the  solution  is  not  invariant 
since  the  units  of  resource  not  allocated  to  the  variables 

o 

in  F must  be  allocated  to  a variable  in  S to  maintain 

optimality.  If  this  condition  is  violated  the  solution  may 
be  invariant  and  to  determine  whether  or  not  the  solution  is 
invariant  requires  additional  algorithm  iterations. 

As  in  the  linear  case  there  is  a logical  statement 
of  the  tests  of  invariance.  This  is  derived  by  recognizing 
that  the  reduced  gradient  algorithm  will  allocate 
incremental  units  of  resource  in  decreasing  or^er  of  the 
maximum  marginal  returns.  At  optimality  all  variables  in  the 
solution  but  not  at  their  upper  bounds  will  have  a common 
marginal  rate  cf  return  A.  As  long  as  the  parametric 
perturbations  allowed  by  the  restricted  ranges  do  not  cause 

o 

the  marginal  return  at  zero  of  a variable  in  S to  become 

+ 

larger  than  the  marginal  return  of  any  variable  in  S the 

solution  will  be  invariant.  This  test  of  invariance  is 
equivalent  to  the  tests  developed  above  and  can  be  expressed 
as 

L L L 

max  (a  +9  ) < min  (a  ♦ 9 )-(b  + 9 )d 

j«S°  j j j«S*  j 3 j j j 

If  within  the  specified  restricted  ranges  the  condition  is 
satisfied  the  solution  is  said  to  be  invariant. 
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VI.  CONCLUSIONS  AND  EXTENSIONS 


The  invariance  criterion  and  the  definitional  framework 
in  which  it  is  applied  provide  an  approach  toward  the 
optimization  of  the  stochastic  program  posed  by  the  overhaul 
planning  problem.  The  complement  of  the  optimal  solution  set 
of  the  deterministic  reformulation  identifies  the  stages  in 
which  no  advance  planning  and  procurement  should  be 
undertaken  and  the  solution  sensitivity  analysis  under  the 
invariance  criterion  provides  some  control  over  the  risk 
involved  in  basing  decisions  on  a deterministic  solution  to 
a stochastic  problem.  The  key  is  that  the  risk  is  only 
controlled  since  even  if  a solution  satisfies  the  invariance 
criterion  there  is  a positive  probability  that  the 
realizations  of  the  stochastic  parameters  will  fall  outside 
the  restricted  ranges  used  for  the  invariance  criterion. 
Thus  even  if  a solution  satisfies  the  invariance  criterion 
it  should  not  be  regarded  as  an  exact  answer,  but  as  a 
foundation  on  which  objective  management  decisions  can  be 
based.  Even  if  a solution  fails  the  tests  of  invariance 
there  is  a positive  result,  the  stages  which  are  susceptible 
to  stochastic  behavior  can  be  identified.  For  a solution 
which  fails  to  satisfy  the  invariance  criterion  there  are 
two  ways  to  move  toward  invariance. 


1.  Reduce  the  variance  of  the  estimate  used  in  the 

deterministic  reformulation.  This  generally 

reguires  an  enlargement  of  the  data  base  used  in  the 
estimation . 

2.  Reduce  the  restricted  ranges  on  which  the  tests  of 
invariance  were  based.  This  will  increase  the  risk 
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associated  with  decisions  based  on  the  solution  as 
there  will  be  a greater  probability  of  realizations 
of  the  stochastic  parameters  falling  outside  the 
restricted  range. 


k significant  improvement  in  the  invariance  criterion 
could  be  achieved  if  the  level  of  risk  associated  with  an 
invariant  solution  could  be  specified.  This  would  require 
the  development  of  a probability  statement  addressing  the 
joint  probability  of  violating  the  specified  restricted 
ranges  of  the  stochastic  parameters.  Unfortunately  a 
realistic  development  of  this  probability  statement  would 
require  dropping  the  assumption  of  independence  for  the 
parametric  perturbations  and  would  necessitate  the 
development  cf  joint  restricted  ranges  for  the  dependent 
parameters.  This  will  greately  complicate  the  mathematics  of 
the  invariance  analysis. 
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